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Abstract 

We consider sequential iterative processes for the common fixed 
point problem of families of cutter operators on a Hilbert space. These 
are operators that have the property that, for any point x Ti, the 
hyperplane through Tx whose normal is x — Tx always "cuts" the 
space into two half-spaces one of which contains the point x while 
the other contains the (assumed nonempty) fixed point set of T. We 
define and study generalized relaxations and extrapolation of cutter 
operators and construct extrapolated cyclic cutter operators. In this 
framework we investigate the Dos Santos local acceleration method in 
a unified manner and adopt it to a composition of cutters. For these 
we conduct convergence analysis of successive iteration algorithms. 
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1 Introduction 



Our point of departure that motivates us in this work is a local acceleration 
technique of Cimmino's jCim38] well-known simultaneous projection method 
for linear equations. This technique is referred to in the literature as the Dos 
Santos (DS) method, see Dos Santos |DSa87j and Bauschke and Borwein 
|BB96i Section 7], although Dos Santos attributes it, in the linear case, to De 
Pierro's Ph.D. Thesis [DPiSlj . The method essentially uses the line through 
each pair of consecutive Cimmino iterates and chooses the point on this 
line which is closest to the solution x* of the linear system Ax = b. The 
nice thing about it is that existence of the solution of the linear system 
must be assumed, but the method does not need the solution point x* in 
order to proceed with the locally accelerated DS iterative process. This 
approach was also used by Appleby and Smolarski |AS05] . On the other 
hand, while trying to be as close as possible to the solution point x* in each 
iteration, the method is not yet known to guarantee overall acceleration of 
the process. Therefore, we call it a local acceleration technique. In all the 
above references the DS method works for simultaneous projection methods 
and our first question was whether it can also work with sequential projection 
methods'! Once we discovered that this is possible, the next natural question 
for sequential locally accelerated DS iterative process, is how far can the 
principle of the DS method be upgraded from the linear equations model? 
Can it work for closed and convex sets feasibility problems? I.e., can the 
locally accelerated DS method be preserved if orthogonal projections onto 
hyperplanes are replaced by metric projections onto closed and convex sets? 
Furthermore, can the latter be replaced by subgradient projectors onto closed 
and convex sets in a valid locally accelerated DS method? Finally, can the 
theory be extended to handle common fixed point problems? If so, for which 
classes of operators? 

In this study we answer these questions by focusing on the class of opera- 
tors T : "H — "H, where "H is a Hilbert space, that have the property that, for 
any x G "H, the hyperplane through Tx whose normal is x — Tx always "cuts" 
the space into two half-spaces one of which contains the point x while the 
other contains the (assumed nonempty) fixed point set of T. This explains the 
name cutter operators or cutters that we introduce here. These operators, 
introduced and investigated by Bauschke and Combettes jBCOH Definition 
2.2] and by Combettes [ComOlj . play an important role in optimization and 
feasibility theory since many commonly used operators are actually cutters. 
We define generalized relaxations and extrapolation of cutter operators and 
construct extrapolated cyclic cutter operators. For this cyclic extrapolated 
cutters we present convergence results of successive iteration processes for 
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common fixed point problems. 

Finally we show that these iterative algorithmic frameworks can handle 
sequential locally accelerated DS iterative processes, thus, cover some of the 
earlier results about such methods and present some new ones. 

The paper is organized as follows. In Section [2] we give the definition of 
cutter operators and bring some of their properties that will be used here. 
Section 12] presents the main convergence results. Applications to specific 
convex feasibility problems, which show how the locally accelerated DS iter- 
ative processes follow from our general convergence results, are furnished in 
Section HI 

2 Preliminaries 

Let "H be a real Hilbert space with an inner product (■, ■) and with a norm 
II ■ ||. Given x,?/ G "H we denote 

H{x,y):={u(^H\{u-y,x-y) <Q}. (1) 

Definition 1 An operator T : H H is called a cutter operator or, in 
short, a cutter 

if FixT C H{x, Tx) for all x eU, (2) 
where Fix T is the fixed point set of T, equivalently, 

q G FixT implies that (Tx — x, Tx — g) < for all x eH. (3) 

The inequality in can be written equivalently in the form 

(Tx — x,q — x) > \\Tx — x|p. (4) 

The class of cutter operators is denoted by T, i.e., 

T := {T ■.H^H \ FixT C H{x,Tx) for all x e H} . (5) 

The class T of operators was introduced and investigated by Bauschke 
and Combettes in |BC01[ Definition 2.2] and by Combettes in |Com01] . Ya- 
mada and Ogura |YO04j and Mainge |MailO] named the cutters firmly quasi- 
nonexpansive operators. These operators were named directed operators in 
Zaknoon |Zak03j and further employed under this name by Segal Seg08 



and Censor and Segal jU508l ICSOSal [USOQ] . Cegielski [CeglOj Definition 



2.1] named and studied these operators as separating operators. Since both 
directed and separating are key words of other, widely-used, mathematical 
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entities we decided in |CCllj to use the term cutter operators. This name 
can be justified by the fact that the bounding hyperplane of H{x, Tx) "cuts" 
the space into two half-spaces, one which contains the point x while the other 
contains the set FixT. We recall definitions and results on cutter operators 
and their properties as they appear in |BC01t Proposition 2.4] and [ComOl] , 
which are also sources for further references. 

Bauschke and Combettes [BCOlj showed the following: 

(i) The set of all fixed points of a cutter operator with nonempty Fix T is 
a closed and convex subset ofT-L, because FixT = nx^uH^x^Tx). 

Denoting by / the identity operator, 



This class of operators is fundamental because many common types of oper- 
ators arising in convex optimization belong to the class and because it allows 
a complete characterization of Fejer-monotonicity |BCOH Proposition 2.7]. 
The localization of fixed points is discussed by Goebel and Reich in |GR84i 
pp. 43-44]. In particular, it is shown there that a firmly nonexpansive oper- 
ator, namely, an operator T : "H — "H that fulfills 



and has a fixed point, satisfies ([3]) and is, therefore, a cutter operator. The 
class of cutter operators, includes additionally, according to [BCOll Propo- 
sition 2.3], among others, the resolvents of a maximal monotone operators, 
the orthogonal projections and the subgradient projectors. Another family of 
cutters appeared recently in Censor and Segal |CS08at Definition 2.7]. Note 
that every cutter operator belongs to the class of operators J-"*^, defined by 



Crombez |Cro05| p. 161], 

:= {T -.n \\Tx - q\\ < \\x - q\\ for all q G FixT and x e H} , 



whose elements are called elsewhere quasi-nonexpansive or paracontracting 
operators. An example of a quasi-nonexpansive operator T : H — )■ is a 
nonexpansive one, i.e., an operator satisfying \\Tx — Ty\\ < \\x — y\\ for all 
x,y en, with FixT ^ 0. 

Definition 2 Let T : "H ^ "H and let A G (0,2). We call the operator 
Tx := J + (1 — A)T a relaxation of T . 



if T e r then I + \{T - I) eT for all A G [0, 1]. 



(6) 



\\Tx — Ty\\^ < {Tx — Ty, x — y) for all x,y eTi, 



(7) 
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Definition 3 We say that an operator T : ^ H with FixT 7^ is strictly 
quasi-nonexpansive if 

\\Tx — z\\ < \\x — z\\ (9) 

for all X ^ FixT and for all z G FixT. We say that T is a-strongly quasi- 
nonexpansive, where a > 0, or, in short, strongly quasi-nonexpansive if 

\\Tx — z\\'^ < \\x — — q;||Tx — x|p (10) 

for all a; G and for all z G FixT. 

It is well-known that a relaxation of a cutter operator is strongly quasi- 
nonexpansive (see [ComOlt Proposition 2.3(ii)]). Since the converse implica- 
tion is also true we have the following result. 

Lemma 4 Let T : l-L l-L he an operator which has a fixed point and let 
A G (0,2). Then T is a cutter if and only if its relaxation T\ is (2 — A)/A- 
strongly quasi-nonexpansive. 

Proof. Since 

T\x — X = X{Tx — x), (11) 
we have, by the properties of the inner product, 

||Tax - zW" - \\x - + ^-^IITao; - xf 

= \\x-z + X{Tx - x)f - ||x - + A(2 - A)||Tx - xf 

= 2A(||Tx — x|p — (2; — X, Tx — x)) = 2\{z — Tx, x — Tx), (12) 

for all a; G H and for all z G Fix T, from which the required result follows. ■ 

Definition 5 We say that an operator T : ^ H is demiclosed at if 
for any weakly converging sequence {x^j^Q, x^ ^ ?/ G as — )■ cxd, with 
Tx^ —J- as A; —> 00, we have Ty = 0. 

It is well-known that for a nonexpansive operator T : "H — )■ "H, the oper- 
ator T — / is demiclosed at 0, see Opial |Opi67 , Lemma 2]. 

Definition 6 We say that an operator T : "H — )■ "H is asymptotically regular 
if 

ll^fc+i^ - T''x\\ ^0, as A; ^ 00, (13) 

for all X eT-L. 



It is well-known that if T is a nonexpansive and asymptotically regu- 
lar operator with FixT 7^ then, for any x E the sequence {T^x} 
converges weakly to a fixed point of T, see |Opi67[ Theorem 1]. 



00 

k=0 
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3 Main results 



We deal in this paper with a finite family of cutter operators Ui : T-L ^ H, 
i = 1,2, ... ,m, with f]™^Fixf/j 7^ and with compositions of Ui, i = 
1,2, ... ,m. We propose local acceleration techniques for algorithms which 
apply this operation. For an operator U : — ?■ H we define the operator 

Ua,\x := X + \(r{x){Ux — x), (14) 

where A G (0, 2) is a relaxation parameter and a : H — ?■ (0, +00) is a step 
size function. We call the operator U„^x the generalized relaxation of U (cf. 
CeglO Section 1] and |CCllt Definition 9.16]). A generalized relaxation 



Ucr^x of U with Acr(x) > 1 for all x G "H is called an extrapolation of U. Of 
course, for x G FixU, we can set a{x) arbitrarily, e.g., a{x) = 1. Denoting 
U„ := it is clear that 

Ua,\X = X + \{UaX — x) , (15) 

and that FixUa^x = FixUa = FixU (note that cr(x) > for all x G Ti). 

Let Ui : T-L Ti he a cutter operator, i = 1,2, . . . ,m, with HHi -^^^ 
0. Define the operator U : H — ?■ H as the composition 

U ■.= UmU^-i---Ui. (16) 

Since any cutter operator is strongly quasi-nonexpansive, (see Lemma Hj), 
FixU = ni^i FixUi and U is strongly quasi-nonexpansive, see [BB96', Propo- 
sition 2.10]. Consequently, U is asymptotically regular, see [BB96 . Corollary 
2.8], and, if U is nonexpansive then any sequence {x^}^q, generated by the 
recurrence (Piccard iteration) 

x° G "H is arbitrary, and a;^+^ = Ux^, for all A; > 0, (17) 



converges weakly to a fixed point of U, see |Opi67 Theorem 1]. We extend 



this convergence result to the generalized relaxation of U, defined by ([T] 
We call an operator U of the form (fT6|) a cyclic cutter. Contrary to the 
simultaneous cutter, a cyclic cutter needs not to be a cutter. This "contra- 
diction of terms" resembles the situation with the, so-called, "subgradient 
projection" onto a convex set which needs not to be a projection onto the 
set because it needs not be an element of the set. 

In order to prove our convergence result for the generalized relaxation of 
U, defined by let 5*0 := / and Si := UiU.i ■ ■ ■ Ui, i = 1,2, . . . ,m. Of 
course, U = Sm- Further, denote 

M° = X, u' = Uiu'~^ and y' = u' - u'~^, for all i = 1,2, . . . ,m. (18) 
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According to this notation, used throughout this paper, we have = S-iX 
and Y^^=i y-' = Ux — Si^ix, i = 1, 2, . . . , m, in particular, Ylf=i = Ux — x. 

Lemma 7 If Ui : l-i l-L, i = 1,2, ... ,m, are cutter operators such that 
fy^i Fix[/j 7^ 0, then for any z G Hlii Fixt/j the following inequalities hold 



m ^ m ^ 

{UX-X,Z-X) > Y^{y^ + y^+^ + ... + y-^,y^) > ^ ||^^f > 



2 ^ " - 2m 

i=l i=l 



i=l 



for all X (zH. 



19) 



Proof. We prove the first inequahty in fll9p by induction on m. For m = 1 it 
follows directly from Definition [T] Suppose that the first inequality in f[T^ is 
true for some m = t. Define Vi := I, Vi := UiUi-i ■ ■ ■ f/2 for z = 2, 3, . . . , t + 1, 
:= h, where h is an arbitrary element of "H, := UiV^~^ and := t>* — 1>*~^, 
2 = 2, 3, . . . , t + 1. If we set /i = Uix then, of course, S'jX = Vih, = and 
y^ = z^, i = 2,3, . . . ,t + 1. It follows from the induction hypothesis that 

t+i 

{Vt+ih -h,z-h)> + z"^' + ■■■ + (20) 

i=2 

for all e ?^ and z G n*^2 Fixf/j. Thus, if /i = f/ix then, for all x G "H and 
z G n*^J Fix[/j, we obtain 

(Sf+ix — x,z — x) = {Vt+ih — x,z — x) 
= {Vt+ih — h, z — x) + {Uix — x,z — x) 

> {Vt+ih -h,z-h) + {Vt+ih -h,h-x) + Wy'f 
t+i I t+i \ 

> Y,{z' + z^^' + ■■■ + z'+\ z') + {y^z\h-x\ + \\y'\\'' 

i=2 \ i=2 I 

t+1 

.1||2 



Y.^y' + y'^' + ■■■ + y'^\ y') + {y' + y'' + ■ ■ ■ + y'^\ y') + \\y' 

i=2 
t+1 

J2{y' + y'^' + --- + y'-'\f). (21) 



i=l 



Therefore, the first inequality in (fT9l) is true for m = t + 1, and the induction 
is complete. The second inequality follows from 

m ^ m -. m 

1=1 i=l i=l 



The third inequahty in ([T^ follows from the convexity of the function || ■ |p. 
■ 

Define the step size function cimax : "H — )■ (0, +00) by 

amUx):= I \\Ux-x\\^ ' ^^^1^^' (23) 

y 1, for X G Fixf/. 

If we set = SiX — Si^ix, i = 1,2, ... ,171, (compare with flTK]) ) in Lemma [3, 
then we obtain for x ^ Fix U 

> > (24) 

Lemma 8 Let Ui : H H be cutter operators, i = 1,2, ... ,m, with 
f^™^Fixf/j 7^ 0. The operator '■= f/o-,i, defined by (fl^ . where the step 
size function a := cTmax ^-s given by (I23p . 25 a cutter. 

Proof. Taking z G f]^-,^ Fix f/j, the first inequality in f[T^ with = S'jX — 
Sj-iX, i = 1, 2, . . . , m, can be rewritten, for all x G 7{, in the form 

\\Ux — x|pcr(x) < (fJx — X, z — x). (25) 

Therefore, for the operator U^x, defined by f|T4|) with the step size a{x) as 
in fl23l). we have 



{Uo-x — x,z — x) = a{x){Ux — x,z — x) > a'^{x)\\Ux — x\\'^ = \\U„x — x\\'^, (26) 
and the proof is complete. ■ 

Theorem 9 Let Ui : l-i ^ %, i = 1,2, ... ,m, be a cutter operator with 
f^^^Fixf/; 7^ 0. Let the sequence {x'^j^Q be defined by 

= f/<x,A,x^ (27) 

where U„^\ is given by (HM . \k G [e, 2 — e] for an arbitrary constant e G (0, 1), 
and a := cXmax is given by fl2^ . Then 



4 \\Ux^ — x^'P 

4/77,2 

/or a// x*^ ^ Fixf/ and for all z G Fixf/. Consequently, x'^ ^ x* G Fixf/ as 
k ^ 00, if one of the following conditions is satisfied: 
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(i) U — I is demiclosed at 0, or 

(ii) Ui — I are demiclosed at 0, for all i = 1,2, .. . 
Proof. Let z G Fixf/. By inequality (121]) . we have 



m. 



\x 



k+l 



< 



< 



< 



X 



x'^ - z 



X 



X 



x'' - z 



+ XlWU^x'' - X 



fc||2 



^ + Xl\\U^x^-x^f-2Xk\\U^x^ -^"2 



2Xk{U^x^ -x'^,z- x") 

Xk{2 - Xk^U^x" - x'f 
Xk{2 - Xk)a\x'')\\Ux'' - x'^f 
A,(2-A,) iJ:T=l\\S^x' - S^.,x'rf 



2 ^''^'^ ^ ^''^ mx'' 



4^2 



\Ux^ - 
■x'\\\ 



X 



k\\2 



(29) 



for all ^ FixU. Therefore, 
and as — !■ oo, we have 

WUx'' 



k _ 2-11 1 oo 



k=0 



is decreasing, {x }^q is bounded 



X 



^0, 



and 



I jS*^^ Si \X II y 0, 



(30) 
(31) 

for all 2 = 1, 2, . . . , m. Let x* G "H be a weak cluster point of {x^}^q and 
{x"'=}^g C {x'^j^Q be a subsequence which converges weakly to x*. 

(i) Suppose that U — I is demiclosed at 0. Condition fl30|) yields that 
X* G FixU. The convergence of the whole sequence {x'^j^Q to x* follows 
now from |BB96l Theorem 2.16 (ii)]. 

(ii) Suppose that Ui — I are demiclosed at 0, for all i = 1,2,. 
Condition flSTl) for z = 1 yields 



m. 



\Uix 



X 



\Six'"' - Sox''" II ^ as A; ^ oo. 



Due to demiclosedness of f/i — / at 0, we have that Uix* = x*. Since 
||(f/ix"'= - Uix*) - (x"* - x*)|| = ||f/ix"'= - x'^'^ll ^ as ^ oo. 



(32) 



(33) 



and x^'' X* , as — )■ oo, we have that Uix^'' Uix* = x* as — ?■ oo. Since 
U2 — I is demiclosed at 0, condition fl^ for z = 2 imphes that U2X* = x*. 
In a similar way we obtain that UiX* = x* for i = 3,4, . . . ,m. Therefore, 



Uix* 



X 



(34) 



We conclude that the subsequence {x"'=}^q converges weakly to a fixed point 
of the operator U . The weak convergence of the whole sequence {x^}^g to 
X* G FixU follows now from [BB96| Theorem 2.16 (ii)]. ■ 
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Remark 10 Note that 



i=l 1=1 

Therefore, the step size crmax(a^) for x ^ Fixt/, given by fl23l) . can be equiva- 
lently written as 



Furthermore, by fl22l) . we have 

2||f/x-x||2 ■ ^^'^ 

Remark 11 Theorem [H] remains true if we suppose that the step size func- 
tion (J is an arbitrary function satisfying the inequahties 

< a{x) < a^Ux), (38) 

\\Ux — xW"^ 

where a e (0, 1/2] and x ^ Fix U. The existence of such a function follows 
from Lemma [71 

Remark 12 Even if we take A = 2, the generalized relaxation U^^^^^x needs 
not to be an extrapolation of U because the inequality crmax(a^) > 1/2 is 
not guaranteed. We only know that amax{x) > l/(2m) (see (1211) ). It is 
known, however, that U is 1/m-SQNE (see [YO041 Proposition l(d)(iii)]), 
consequently, it is a 2m/ {m + l)-relaxed cutter (see Lemma H]). Therefore, 
U i+m is a cutter. Since is a cutter (see Lemma [8]), one can easily check 

2m 

that f/o- is also a cutter, where 

a = max((l + m)/(2m),o-max)- (39) 

Therefore, U^j^x with A G (2m/ (m + 1),2] is an extrapolation of U and one 
can expect that an application of Ua,x leads in practice to a local acceleration 
of the convergence of sequences generated by the recurrence x^^^ = Ua^x^x^i 
in comparison to the classical cyclic cutter method x^^^ = Ux^. Note, that if 
we apply the step size a given by (15^ . then Theorem [H] remains true, because 
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4 Applications 



In this section we show how our general results unify, generalize and extend 
several existing local acceleration schemes. We consider two kinds of opera- 
tors Ui satisfying the assumptions of Section [S] (i) f/j is the metric projection 
onto a closed and convex set Ci C Ti, and (ii) Ui is a subgradient projection 
onto a. set Ci = {x E Ti \ Ci{x) < 0}, where q : — j- M is a continuous and 
convex function, i = 1,2, ... ,m. Recall that Fix P^i = Ci and that Pc\ is 
a firmly nonexpansive operator (see, e.g., Zarantonello [ZarTlt Lemma 1.2]), 
consequently, P^i is both nonexpansive (by the Cauchy-Schwarz inequality) 
and a cutter operator (see |BB96l Lemma 2.4 (ii)]). Furthermore, Opial's 
demiclosedness principle yields that the operator Pq — J is demiclosed at 
(see |Opi67[ Lemma 2]). 



First we consider the case Ui = Pd- If Cj C is a general closed and 
convex subset, one can apply Theorem [9] directly. If Ci is a hyperplane, i.e., 
Ci = H{a\hi) := {x E T-i \ {a\x) = where a* G "H, a* 7^ and hi G M, 



then 



:= Pc.x = X - ^^^^4^«^- (40) 



In this case an application of Theorem [9] will be presented in Subsection 14. 1[ 
If Ci is a half-space, Ci = H_{a\bi) := {x G "H | {a\x) < bi}, then 

U. := Pc.x = X - ^-^^^4-^a\ (41) 

where «+ := max(0, a) for any real number a. In this case an application 
of Theorem [9] will be presented in Subsection 14. 2[ 

Now consider the case, where Ui is a subgradient projection onto Ci : = 
{x G "H I Ci{x) < 0}, where q : — )■ R is a continuous and convex function. 
Then we have 

^'^^'^))t^,(x), if^7.(x)^0. 



U.x = P,x := <; MxW'^' ^ (42) 

if gi{x) = 0, 

where gi{x) G dci{x) := {g e Ti \ {g,y - x) > Ci{y) - Ci{x), for all y eH] is 
a subgradient of the function Cj at the point x. It follows from the definition 
of the subgradient that Ui is a cutter, i = 1, 2, . . . , m. Note that Fix Ui = Ci, 
consequently, 

m 

Pi Fix [/i = C 7^ 0. (43) 
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Suppose that the subgradients gi are bounded on bounded subsets, i E I 
(this holds if, e.g., H = M", see [BB96[ Corollary 7.9]). Then the operator 
Ui — Id is demiclosed at 0, i G /. Indeed, let x* and limfc_>.oo \\UiX^ — 

x'^W = 0. Then we have 

lim \\Uix'' -x''\\= lim ^^^^T^ = 0. (44) 
fc->oo fc-5-oo ||5(j(a;'^) II 

The sequence {x'^j^Q is bounded due to its weak convergence. Since a con- 
tinuous and convex function is locally Lipschitz-continuous, the subgradients 
sequence {5'i(a:^)}^Q is also bounded. Equality (jH]) implies now the conver- 
gence liuifc-s-oo Ci{x'')+ = 0. Since q is weakly lower semi-continuous, we have 
Ci{x*) = 0, i.e., Ui — Id is demiclosed at 0. 

The local acceleration schemes of the cyclic projection and the cyclic 
subgradient projection methods, referred to in Subsections 14. 14.21 and 14.31 
below, follow the same basic principle of the Dos Santos (DS) local acceler- 
ation principle referred to in Section [H Namely, consider the line through 
two consecutive iterates of the cyclic method applied to a linear system of 
equations and find on it a point closest to the nonempty intersection of the 
feasibility problem sets. 

4.1 Local acceleration of the sequential Kaczmarz 
method for linear equations 

Consider a consistent system of linear equations 

{a\x) = bi, z = l,2, ...,m, (45) 

where a* G "H, a* 7^ and bi E M, for alH = 1, 2, . . . , m. Let Ci = H(a\ hi) := 
{x E v. \ {a\x) = hi}, Ui = be defined by fHOj) . i = 1,2, ...,m, and 
assume that C := fll^i 7^ ^- Denote U := UmUm-i ■ ■ - Ui. The operator U 
is nonexpansive as a composition of nonexpansive operators. The Kaczmarz 
method for solving a system of equations (145|) has the form 

x^+'' = Ux\ (46) 

where x*^ G "H is arbitrary. The method was introduced by Kaczmarz in 1937 
for a square nonsingular system of linear equations in M" (see |Kac37j ). It 
is well-known that for any starting point x° G "H any sequence generated by 
the recurrence (1461) converges strongly to a fixed point of the operator U (see 
|GPR67| Theorem 1]). The local acceleration scheme for this method fH6|l 
which we propose here is a special case of the iterative procedure x^^^ = 
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U^^x^x^, where the operator U„^x is defined by ([HD, the step size function 
cr : — 7- (0, +00) is defined by fl5B]) and the relaxation parameter is A G (0, 2). 
Since 

m m 

''^^{SiX — X, SiX — Si^ix) = ''^^{SiX — X, UiU^~^ — u^~^) 



i=l i=l 

m 



2^{S.,x-x, -— a) 



i=l 



m 



Jet 

i=l 



E '-'lKiif l^-Ha-.x)), (47) 



i=l 



we obtain the following form for the step size 



Y.{k-{a\x))- 



1=1 



^max(x) = 1|^^_^||2 ' (48) 

where x ^ Fixt/. This step size is equivalent to those in (123|) . ( 136|) and (137|) . 

Corollary 13 Let f/ := UmUm-i ■ ■ - Ui, where Ui is given by ( HOj) . i = 
1, 2, . . . , m, t/ie sequence {x^}^q C Ti be defined by the recurrence 

x^+i = ?7,,;,^x^ = x'^ + Afe(T(x'=)(f/x'^ - x'') (49) 

/or a//x^ ^ FixU, where x^ is arbitrary, a := (Xmax is defined by (1481) and 
Xk G 2 — e] for an arbitrary constant e G (0, 1). Then {x'^j^Q converges 
weakly to a solution of the system fHSjl . 



One can prove even the strong convegence of {x^}'^^ in Corollary[T3l The 
proof will be presented elsewhere. As mentioned in Remark [T2l Corollary [13] 
remains true, is we set a := max((m + l)/(2m), (Xmax)- In this case, the 
method is an extrapolation of the Kaczmarz method if Xk G (2m/ (m + 1), 2]. 

Remark 14 When Ci are hyperplanes and Ui = Pq, z = 1, 2, . . . , m, then, 
for any m G "H and for any 2; G Cj, we have 

{UiU — u, z — u) = \\UiU — (50) 
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i = 1,2, ... ,m. Therefore, it follows from the proof of Lemma [7] that the first 
inequality in flTI?]) is, actually, an equality. Consequently, we have equality in 
(125|) and the operator Ua defined by ([Hj) with the step size a := (Xmax given 
by (jUj) has the property 

{UaX — X,Z — UaX) = 0, (51) 

for all z G C, or, equivalently, 

{UaX — X, Z — x) = \\UaX — (52) 

This yields the following nice property of the operator Ua 

\\UaX — z\\ = min{||x + a{Ux — x) — z\\ | a G M}, (53) 

for all z E C. We can expect that this property leads in practice to a 
local acceleration of the convergence to a solution of the system (H5i) . of 
sequences generated by the recurrence x^~^^ = Ua^\^,x^ , where the operator 
f/o- A is defined by (IT^ with the step size given by (HSi) and G [e, 2 — e] for 
an arbitrary constant e G (0, 1). 

4.2 Local acceleration of the sequential cyclic projec- 
tion method for linear inequalities 

Given a consistent system of linear inequalities 

{a\x)<bi, i = 1,2, . . . ,m, (54) 

where a' e n, a' ^ and k G M. Let Ci = H_{a\hi) := {x G "H | 
{a\ x) < hi] and f/j = i = 1,2, . . . ,m, he defined by fHT]) . Assume that 
C = riilLi 7^ 0- Denoting Sq := /, Si := UiUi^i ■ ■ ■ Ui, i = 1,2, . . . ,m, we 
have U = Sm- By the nonexpansiveness of U, Theorem [9](i) guarantees the 
weak convergence of sequences generated by the recurrence x^"*"^ = Ua^x^x'^, 
where the starting point x^ E H is arbitrary, the step size function is given 
by dSSD and the relaxation parameter G [b,2 — e] for an arbitrary constant 
e G (0, 1). Since U is nonexpansive, we would rather prefer to apply the step 
size a{x) given by (137|) . and, as explained in Remark [TT| the convergence 
also holds in this case. Note that property (l53l) does not hold in general for 
a system of linear inequalities. An application of the step size a{x) given by 
ensures that f/g- is a cutter but does not guarantee that \\Uo-x — z\\ < 
\\Ux — z\\ for any z G fli^i unless a{x) > 1. 
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The step size a{x) can be also presented, equivalently, in the following 
way. Denote, as before, = SiX, i.e., = x, = UiU"^'^, i = 1,2, ... ,m. 
Of course, -u™ = Ux thus, 

ux = u' + Y,{u^ - u^~') = x-Y, ^^^^nrt^"'- ^^^^ 



1^ 

1=1 1=1 " 



For any 2; G C we have. 



{Ux - X, z - x) = - {S^ ^^~~^~V^T|I~~^^'' ^ ~ ^ 



l«1 



i=l 

((a\M-i)-A). 



j=i II II 



m 



i=l 

i.e., 



>i:(K,x)-6.) (<-'-r^l„-^-)\ (56) 



{Ux -x,z-x)> f^((a\ x) - (57) 
^ ll« II 

The same inequality can be obtained by an application of the first in- 
equality in (IT^ . We can apply the above inequality to define the following 
step size 

where x ^ Fix U. As mentioned in Remark [T2l an application of the following 
step size 

/m + 1 \ 

a{x) = max — ,crmax(a;) , (59) 



2m 

where x ^ Fix?7 (compare with Remark [T2|) . seems reasonable. 

Corollary 15 Let U := UmUm-i - ■ - Ui, where Ui is given by f HTj) . i = 
1, 2, . . . , m, the sequence {x'^l^o C H &e defined by the recurrence 

x'^+i = x'= + Afea(x^)(f/x'=-x'=), (60) 

for all x^ ^ Fixt/, where x^ & H is arbitrary, a := (Tmax ^-5 fl'^wen 6^/ 
fl58|) anc/ G [e, 2 — e] /or an arbitrary constant e G (0, 1). T/ien {x^}^q 
converges weakly to a solution of the system ([5i 
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One can prove even the strong convegence of {x'^j^Q in CorollaryUSi The 
proof will be presented elsewhere. As mentioned in Remark [T21 Corollary [THl 
remains true, is we set o := max((m + l)/(2m), (Jmax)- 

4.3 Local acceleration of the sequential cyclic subgra- 
dient projection method 

Let Cj : — 7- M be continuous and convex functions, i = 1,2, ... ,m and 
consider the following system of convex inequalities 

Ci{x) <0,i = 1,2,..., m. (61) 

Denote Ci := {x E \ Ci{x) < 0}, i = 1,2, ... ,m, and assume that C = 
fT=iCi ^ 0. Define the operators Ui : H U hy i = 1,2,..., m. 

Letting 5*0 := /, Si := UiUi-i - ■ - Ui, m' = SiX and y'^ = — u^~^ for all 
2 = 1, 2, . . . , m, we have, by Remark [T0| 

m m 

^ ^ ('S'm^ Si-lX, SiX Si^iX) = ^ ^^ {SiX X, SiX Si—iX) 

1=1 i=l 

m 

= J2{Uiu'-' - X, U,u'-^ - u'~^) 

i=l 

(62) 

and the step size given by fl23|) can be written in the form 

a„,ax(x) = 1|^^_^||2 ' (63) 

where x ^ Fix U . 

Let f/o-,A be defined by f|T^ . where A G (0,2) and cr(x) is given by fl63|) . 
We obtain the following corollary. 

Corollary 16 Let U := U„iUm~i - ■ - Ui, where Ui is given by f H2]) . i = 
1,2, ... ,m. Let the sequence {x'^j^Q cTi be defined by the recurrence 



X 
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for all ^ FixU, where & H is arbitrary, a := (Tmax is given 
by flB^ . and G [£, 2 — e:] for an arbitrary constant e G (0,1). Then 
{x'^j^Q converges weakly to an element of C . 

As mentioned in Remark WI\ Corollary [TBI remains true, is we set a : = 
max((m + l)/(2m),crmax)- 
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